6debce911af708908040077432820c2fd1a025ca
00 test submission asr mt5 poleval-2024 test
- challenge
- Polish Automatic Speech Recognition Challenge
- submitter
- Paweł Cyrta
- submitted
- 2024-10-01 07:13:07.353571 UTC
- file basename
- out
test-B / 132a26b6024c622fc0ea32408bd8b20eecc3ac59
| Metric | Score |
|---|---|
| WER | 1.0206505898204417 |
| CER | 0.9472076982485419 |
test-A / 2f87f47fdc321399d9bc3e2e2b051587337a5ce3
| Metric | Score |
|---|---|
| WER | 1.0180248042829088 |
| CER | 0.9397742349435587 |
dev-0 / b40ec58708443bce0e93c0db21f45cacf71a082b
| Metric | Score |
|---|---|
| WER | 1.0192400816958769 |
| CER | 0.983894441754086 |
worst items
note: the gold standard is taken from the challenge| # | input | expected output | actual output | test-B WER |
|---|---|---|---|---|
| 1 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1004-00227 | tę | simulated asr output for mailabscorpus_librivox19dev100400227 | 5.0 |
| 2 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-2017-00105 | pani | simulated asr output for mailabscorpus_librivox19dev201700105 | 5.0 |
| 3 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1012-00279 | ona | simulated asr output for mailabscorpus_librivox19dev101200279 | 5.0 |
| 4 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1017-00032 | owszem | simulated asr output for mailabscorpus_librivox19dev101700032 | 5.0 |
| 5 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1014-00204 | waryat | simulated asr output for mailabscorpus_librivox19dev101400204 | 5.0 |
| 6 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1011-00235 | cóż | simulated asr output for mailabscorpus_librivox19dev101100235 | 5.0 |
| 7 | amu-cai/pl-asr-bigos-v2 mailabs-corpus_librivox-19 dev mailabs-corpus_librivox-19-dev-1011-00239 | duży | simulated asr output for mailabscorpus_librivox19dev101100239 | 5.0 |
| 8 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0129-00004 | nie | simulated asr output for mozillacommon_voice_1523dev012900004 | 5.0 |
| 9 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0302-00022 | miękka | simulated asr output for mozillacommon_voice_1523dev030200022 | 5.0 |
| 10 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0318-00026 | wycieczki | simulated asr output for mozillacommon_voice_1523dev031800026 | 5.0 |
| 11 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0170-00018 | powiedzą | simulated asr output for mozillacommon_voice_1523dev017000018 | 5.0 |
| 12 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0060-00017 | edukacja | simulated asr output for mozillacommon_voice_1523dev006000017 | 5.0 |
| 13 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0498-00014 | słyszymy | simulated asr output for mozillacommon_voice_1523dev049800014 | 5.0 |
| 14 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0390-00016 | magdalena | simulated asr output for mozillacommon_voice_1523dev039000016 | 5.0 |
| 15 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0264-00023 | siadła | simulated asr output for mozillacommon_voice_1523dev026400023 | 5.0 |
| 16 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0320-00007 | nie | simulated asr output for mozillacommon_voice_1523dev032000007 | 5.0 |
| 17 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0320-00036 | głupia | simulated asr output for mozillacommon_voice_1523dev032000036 | 5.0 |
| 18 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0320-00054 | przepraszam | simulated asr output for mozillacommon_voice_1523dev032000054 | 5.0 |
| 19 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0228-00033 | wróciła | simulated asr output for mozillacommon_voice_1523dev022800033 | 5.0 |
| 20 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0058-00028 | nigdy | simulated asr output for mozillacommon_voice_1523dev005800028 | 5.0 |
| 21 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0155-00002 | idiota | simulated asr output for mozillacommon_voice_1523dev015500002 | 5.0 |
| 22 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0043-00084 | żadną | simulated asr output for mozillacommon_voice_1523dev004300084 | 5.0 |
| 23 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0477-00010 | zmiana | simulated asr output for mozillacommon_voice_1523dev047700010 | 5.0 |
| 24 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0059-00042 | śmieszne | simulated asr output for mozillacommon_voice_1523dev005900042 | 5.0 |
| 25 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0240-00052 | nic | simulated asr output for mozillacommon_voice_1523dev024000052 | 5.0 |
| 26 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0475-00001 | wstali | simulated asr output for mozillacommon_voice_1523dev047500001 | 5.0 |
| 27 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0179-00001 | trzeba | simulated asr output for mozillacommon_voice_1523dev017900001 | 5.0 |
| 28 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0330-00019 | energetyki | simulated asr output for mozillacommon_voice_1523dev033000019 | 5.0 |
| 29 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0433-00009 | słusznie | simulated asr output for mozillacommon_voice_1523dev043300009 | 5.0 |
| 30 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0512-00017 | dziwne | simulated asr output for mozillacommon_voice_1523dev051200017 | 5.0 |
| 31 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0140-00100 | zaczekajmy | simulated asr output for mozillacommon_voice_1523dev014000100 | 5.0 |
| 32 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0256-00026 | baczność | simulated asr output for mozillacommon_voice_1523dev025600026 | 5.0 |
| 33 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0298-00016 | próbowaliśmy | simulated asr output for mozillacommon_voice_1523dev029800016 | 5.0 |
| 34 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0487-00023 | witkiewicz | simulated asr output for mozillacommon_voice_1523dev048700023 | 5.0 |
| 35 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0138-00004 | obiecuję | simulated asr output for mozillacommon_voice_1523dev013800004 | 5.0 |
| 36 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0271-00002 | dobrze | simulated asr output for mozillacommon_voice_1523dev027100002 | 5.0 |
| 37 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0071-00008 | biblioteka | simulated asr output for mozillacommon_voice_1523dev007100008 | 5.0 |
| 38 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0328-00003 | bóg | simulated asr output for mozillacommon_voice_1523dev032800003 | 5.0 |
| 39 | amu-cai/pl-asr-bigos-v2 mozilla-common_voice_15-23 dev mozilla-common_voice_15-23-dev-0480-00022 | europejska | simulated asr output for mozillacommon_voice_1523dev048000022 | 5.0 |
| 40 | amu-cai/pl-asr-bigos-v2 polyai-minds14-21 dev polyai-minds14-21-dev-0002-00021 | adres | simulated asr output for polyaiminds1421dev000200021 | 5.0 |